Papers with estimation method
Decoupling Adversarial Training for Fair NLP (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing work assumes main task labels and protected attributes are available in the dataset, but protected labels are often unavailable or only available in limited numbers. |
| Approach: | They propose a method which uses only a small volume of protected labels to train adversarial models using a dataset with a discriminator. |
| Outcome: | The proposed method can be used to transfer private-labelled instances from one dataset to another without requiring large amounts of protected labels. |
Embedding Words as Distributions with a Bayesian Skip-gram Model (C18-1)
Copied to clipboard
| Challenge: | Rather than assuming that word embeddings are fixed across the entire text collection, we generate them from word-specific prior densities for each word. |
| Approach: | They propose a method for embedding words as probability densities in a low-dimensional space from a word-specific prior density for each occurrence of a given word. |
| Outcome: | The proposed method can encode word as a distribution on a range of benchmarks and is comparable to Gaussian embeddings. |
Uncertainty-Aware Cross-Lingual Transfer with Pseudo Partial Labels (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to train pre-trained language models for zero-shot cross-lingual tasks are noisy and lack confidence. |
| Approach: | They propose an uncertainty-aware cross-lingual transfer framework with pseudo-partial-label to maximize the utilization of unlabeled data by reducing noise. |
| Outcome: | The proposed framework outperforms baselines on named entity recognition and natural language inference tasks on 40 languages. |
Uncertainty Quantification for In-Context Learning of Large Language Models (2024.naacl-long)
Copied to clipboard
Chen Ling, Xujiang Zhao, Xuchao Zhang, Wei Cheng, Yanchi Liu, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Jie Ji, Guangji Bai, Liang Zhao, Haifeng Chen
| Challenge: | Existing studies on in-context learning have focused on quantifying the uncertainty associated with the model's response, but they neglect the complexity of the LLM and the uniqueness of in-constitut learning. |
| Approach: | They propose a method to quantify the uncertainty associated with in-context learning and propose corresponding estimation method to quantify both types of uncertainties. |
| Outcome: | The proposed method offers an unsupervised way to understand the prediction of in-context learning in a plug-and-play fashion. |